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One of the main goals of the Tevatron Runll is to look for any hints for new physics. At DO, the range of 
searches for new physics signals is large and one of the places we look for hints for new physics is by measuring 
the top quark properties. A few of these measurements are discussed in this paper. 



1. Introduction 

Tevatron, a pp collider with center of mass energy of 
about 2 TeV, is currently world's highest energy col- 
lider in operation. It has been running quite efficiently 
for the last many years delivering more than 6 fb^^ in- 
tegrated luminosity in Runll so far. The DO detector 
has also been performing excellently. The motivation 
to accumulate as much luminosity as possible is not 
only to find Higgs and do precision measurements but 
also to look for new physics signals and rule out as 
many physics models as one can. The top quark is by 
far the heaviest fermion in the standard model, and 
thus has the strongest coupHng to the Higgs boson 
of all standard model fermions. This makes the top 
quark and its interactions an ideal place to look for 
new physics related to electroweak symmetry break- 
ing. In this paper, we present three analyzes which 
look for new physics signals in the top quark sector. 



2. Measurement of CKM matrix element 
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tb 



Within the standard model the top quark decays 
to a W boson and a down-type quark q (q = d; s; 
b) with a rate proportional to the squared Cabibbo- 
Kobayashi- Maskawa (CKM) matrix element [ij. Un- 
der the assumption of three fermion families and a uni- 
tary 3x3 CKM matrix, the Vtq elements are severely 
constrained 0. However, in the presence of new 
physics CKM submatrix may not be a 3X3 unitary 
matrix and in that case Vtq elements can significantly 
deviate from their standard model values. This would 
affect, among other things, the ratio R of the top 
quark branching fractions, which can be expressed in 
terms of the CKM matrix elements as 
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Thus by measuring R precisely we can set limit on 
the ratio of |X4fcp to the off-diagonal matrix elements 
without any assumptions on the unitarity of the CKM 
matrix. The analysis presented here is based on data 



collected with the DO detector Q between August 
2002 and December 2005 at the Fermilab Tevatron 
pp collider at \/s = 1.96 TeV, corresponding to an in- 
tegrated luminosity of about 0.9 fb~^. The analysis 
uses the top quark pair production. Within standard 
model top quarks decay to a boson and a b quark 
almost 100% of the time. For this analysis we only 
consider events in which one of the W bosons decays 
into two quarks, and the other one into an electron or 
muon and a neutrino. 

We identify 6-jets using a neural-network tagging al- 
gorithm. We split the selected sample into subsamples 
according to the lepton flavor (e or /i), jet multiplicity 
(3 or > 4 jets) and number of identified b-jeta (0, 1 or 
> 2), thus obtaining 12 disjoint data sets. Since the 
probability to tag a ti event depends on the flavor 
of the jets, it depends on R. We estimate the accep- 
tance and tagging probabilities for each of the three tt 
decay modes bb, bqi and qiqi. Figure [T] shows tagging 
probabilities as a function of R for tt events with > 4 
jets and 0, 1 and >2b tags. 



3. Anomalous Wtb couplings 

Anomalous Wtb couplings modify the angular cor- 
relations of the top quark decay products and change 
the single top quark production cross section. In this 
paper we also present the first study of Wtb couplings 
that combines W helicity measurements in top quark 
decay with anomalous coupling searches in the single 
top quark final state. 

The effective Lagrangian describing the Wtb inter- 
action including operators up to dimension five is: 



^b^VtbiftPL + fl^PR)tW- 

where Mw is the mass of the W boson, q^, is its four- 
momentum, Vtb is the Cabibbo-Kobayashi-Maskawa 
matrix element, and — (1—75)72 (P^ = (l-|-75)/2) 
is the left-handed (right-handed) projection operator. 
In the standard model, the Wtb coupling is purely 
left-handed, and the values of the coupling form fac- 
tors are f[ « 1, /I' = = f^ = 0. For this analysis 
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Figure 1: Above: Fractions of events with 0, 1 and > 2 b 
tags as a function of R for tt events with > 4 jets; Below: 
predicted and observed number of events in the 0, 1 and 
> 2 b tag samples for the measured R and tt for events 
with > 4 jets. 



we assume real coupling form factors, implying CP 
conservation, and a spin-i top quark which decays 
predominantly to Wb. 

We investigate one pair of coupling form factors 
at a time and consider three cases, pairing the left- 
handed vector coupling form factor f^ with each of 
the other three form factors. We refer to these as 
(Li,_Ri), (Li,_L2), and (Li,i?2). For each pair under 
investigation we assume that the other two have the 
standard model values. 

In this analysis we combine information from our 
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Figure 2: The 68%, 95%, and 99% C.L. band for Rtme 
as a function of R. The dotted black line indicates the 
measured value R = 0.97. 



measurement of the W boson helicity fractions in tt 
events 5] with information from single top quark pro- 
duction. We have set direct limits on anomalous top 
quark coupling before @ but those limits are based 
on single top quark final states only. This new mea- 
surement is based on a sample of 0.9 fb ~^ of single top 
candidate events and up to 2.7 fb ~^ of candidates 
collected by the DO detector. 

The W boson helicity measurement, described in 
Ref. 0, uses events in both the ^-|-jets {ti — s- 
W+W-hh Ivqqhb) and dilepton {tt W+W-bb 
Ivl'v'bb) final states, and is extracted form the distri- 
bution of 6* , the angle between the down-type fermion 
and top quark momenta in the W boson rest frame. 
For each pair of form factors a likelihood distribu- 
tion is extracted from the W helicity measurement of 
the decay angle distribution in top quark decays. We 
vary both the longitudinal and right-handed helicity 
fractions fo and f+ in the fit and find the relative like- 
lihood of any set of helicity fractions being consistent 
with the data. The result is presented in Fig. [31 which 
also demonstrates how non-SM values for the coupling 
form factors alter the W helicity fractions. 

This likelihood from the W helicity analysis is then 
used as a prior in a Bayesian statistical analysis for the 
anomalous coupling search in single top quark produc- 
tion and decay channels, yielding a two dimensional 
posterior probability density as a function of both 
form factors. We extract limits on //^, /^, and 
by projecting the two-dimensional posterior onto the 
corresponding form factor axis. The W boson helicity 
measurement is described in Ref. 5] and the helecity 
priors are shown in Fig. [4] 

The dominant tree level Feynman diagrams for sin- 
gle top quark production in pp collisions are illus- 
trated in Fig. [5] In this analysis we combine both 
these production modes and assume that single top 
quark production proceeds exclusively through W bo- 
son exchange. The presence of anomalous couplings 
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Figure 3: Graphical representation of the change in W 
boson helicity fractions away from the SM values (shown 
by the star) if the anomalous couplings are present. 



can change angular distributions and event kinematics 
as demonstrated by the px spectrum of the charged 
lepton from the decay of the top quark in Fig. [6l Such 
differences can be used to distinguish these coupUngs. 
We use boosted decision trees to discriminate between 
the single top quark signal and background. 

We use Bayesian statistics to compare the output 
distribution of the decision trees from data to expec- 
tations for single top quark production. For any pair 
of values of the two couplings that are considered non- 
zero, we compute the expected output distribution by 
superimposing the distributions from the two signal 
samples with the non-standard coupling and from the 
background samples in the appropriate proportions. 
In case of the (Li,L2) scenario, the two amplitudes 
interfere, and we use a superposition of three signal 
samples, one with left-handed vector couplings, one 
with the left-handed tensor coupling only set to one, 
and one with both couplings set to one to take into ac- 
count the effect of the interference. We then compute 
a likelihood as a product over all bins and channels. 
Here we use twelve channels defined by lepton flavor, 
b tag multiplicity, and jet multiplicity (2, 3, or 4). 

The two-dimensional posterior probability density 
is computed as a function of j/fp and where fx 

is fi^: /2'j or f2- These probability distributions are 
shown in Fig. [71 In all three scenarios we measure ap- 
proximately zero for the anomalous coupling form fac- 
tors and favor the left-handed vector hypothesis over 
the alternative hypothesis. We compute 95% Con- 
fidence Level (C.L.) upper limits on these form fac- 




Figure 4: W helicity prior for right- vs left-handed vec- 
tor coupling (a), left-handed tensor vs left-handed vector 
coupling (c), and right-handed tensor vs left-handed vec- 
tor coupling (e). The W helicity prior is normalized to a 
peak value of one and shown as equally spaced contours 
between zero and one. 
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Figure 5: Feynman diagrams for (a) s-channel and (b) t- 
channel single top quark production. 
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Figure 6: Charged lepton pr spectrum from data and ex- 
pectation for SM single top production plus background 
for events with two jets, one fo-tagged jet. Superimposed 
are the distributions from single top quark production with 
different couplings (all other couplings set to zero) normal- 
ized to ten times the SM single top quark cross section. 

tors by integrating out the left-handed vector cou- 
pling form factor to get a one-dimensional posterior 
probability density. The measured values are given in 
Table H 



4. Top- antitop spin correlations 

Top quark physics plays an important role in testing 
the atandard model and its possible extensions. One 
of the most important properties of the top quark, 
the spin, has not been carefully explored. While the 
top quarks and antiquarks produced at hadron collid- 
ers are unpolarized, their spins are correlated. Since 
at the Tevatron top pair production is dominated by 
qq scattering, a different spin correlation is analyzed 
compared to the LHC where top pair production is 
dominated by gg scattering. The standard model pre- 
dicts that the top quark decays before its spin flips, in 
contrast with the lighter quarks, which are depolar- 
ized by QCD interactions long before they fragment. 
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Figure 7: final posterior density for right- vs left-handed 
vector coupling (b) , left-handed tensor vs left-handed vec- 
tor coupling (d), and right-handed tensor vs left-handed 
vector coupling (f). The posterior density is shown as con- 
tours of equal probability density. 
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Table I Measured values with uncertainties and upper lim- 
its at the 95% C.L. for Wtb couplings in three different 



scenarios. 



Scenario Coupling 



Coupling limit if /i 
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The spin of the top quark is therefore reflected by its 
decay products. In this analysis it is assumed that 
top quarks decay exactly as predicted by the stan- 
dard model. Then the charged lepton from a leptonic 
top quark decay has a spin analyzing power of 1 at the 
tree level. Therefore, the dilepton final states have the 
highest sensitivity to measure the correlation between 
the spins of pair-produced top and anti-top quarks. 
The observation of spin correlations would result in 
an upper limit on the lifetime of the top quark. This 
can be translated into a lower limit on the Kobayashi- 
Maskawa matrix element |Vtf,p without making as- 
sumptions about the number of quark generations. 
Moreover, many scenarios beyond the standard model 
predict different production and decay dynamics of 
the top quark, which could affect the observed spin 
correlation. In the analysis presented here, the dou- 
ble differential angular distribution is used. The dou- 
ble differential distribution for a measurement of spin 
correlations between top and and antitop quark can 
be expressed as: 



da 



1 



a dcos9icos62 



1 



(1 — Ccos6icos92 



where a denotes the cross section of the channel un- 
der consideration and C is a free parameter between 
-1 and 1 that depends on the choice of the spin ba- 
sis. For this analysis the beam axis was chosen to be 
the spin quantization axis for which the value for the 
coefficient constant including NLO QCD corrections 
is C = 0.777. For this measurement, we analyze the 
dileptonic decay channels where the W bosons from 
the top and antitop quark decay into an electron and 
an electron neutrino or into a muon and a muon neu- 
trino. The ee channel with 1.1 fb the channel 
with 4.2 fb ~^ and the /Lt/i channel with 1.1 fb ~^ of 
integrated luminosity are analyzed separately and are 
then combined. The cos9icos92 distribution for the 
full sample is shown in Fig. [51 A likelihood fit for data 
gives a measured value for the spin correlation param- 
eter Cmeas = -OMtoH (stat + syst). The calibrated 
spin correlation coefficient Cmeas — "O-l^to'ss (^^^t 
+ syst) has been measured using Feldman-Cousins 



procedure and is shown shown in Fig. [51 This agrees 
with the standard model prediction for a spin 1/2 top 
quark of C = 0.777 in NLO QCD within 2 standard 
deviations. 

For analysis details please see Ref. 
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Figure 8: The cos (^1) cos (^2) distribution for full dilep- 
ton event sample. The sum of tt signal including NLO 
QCD spin correlation (C = 0.777) and multijet, diboson 
and Drell-Yan background is compared to data. The open 
black histogram shows the prediction without ti spin cor- 
relation (C = 0); 
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Figure 9: The 68%, 95%, and 99% C.L. band for Ctme as 
a function of Cmeas- The thin, slanted line indicates the 
most probable value of Ctrue as a function of Cmeas and 
represents therefore the bias of the method. The vertical 
black line depicts the measured value Cmeas ~ —0.090. 
The horizontal line indicates the NLO QCD value Ctrue = 
0.777. 
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